Metascheduling and Heuristic Co-Allocation Strategies in Distributed Computing

In this paper, we address problems of efficient computing in distributed systems with non-dedicated resources including utility grid. There are global job flows from external users along with resource owner's local tasks upon the resource non-dedication condition. Competition for resource reservation between independent users, local and global job flows substantially complicates scheduling and the requirement to provide the necessary quality of service. A metascheduling concept, justified in this work, assumes a complex combination of job flow dispatching and application-level scheduling methods for parallel jobs, as well as resource sharing and consumption policies established in virtual organizations and based on economic principles. We introduce heuristic slot selection and co-allocation strategies for parallel jobs. They are formalized by given criteria and implemented by algorithms of linear complexity on an available slots number

Metascheduling Strategies in Distributed Computing with Non-dedicated Resources

In this chapter, we address problems of efficient computing in distributed systems with non-dedicated resources including utility Grid. There are global job flows from external users along with resource owner’s local tasks upon resource non-dedication condition. Competition for resource reservation between independent users, local and global job flows substantially complicates scheduling and the requirement to provide the necessary quality of service. A metascheduling concept, justified in this work, assumes a complex combination of job flow dispatching and application-level scheduling methods for parallel jobs, as well as resource sharing and consumption policies established in virtual organizations and based on economic principles

Composite Scheduling Strategies in Distributed Computing with Non-dedicated Resources

AbstractThis work presents dispatching strategies based on methods of job-flow and application-level scheduling in virtual organizations of distributed computational environments with non-dedicated resources. Job-flow management is implemented with the set of specific rules for resource usage. Applications are considered as parallel jobs. Strategies are based on economic scheduling models and diverse administration policies inside resource domains (clusters, computational nodes equipped with multicore processors etc.). Methods of priority economic scheduling of global job flows and local-level applications in distributed computations are studied. Job management structures and economic mechanisms for load balancing in distributed environments are considered

Preference-based Fair Resource Sharing and Scheduling Optimization in Grid VOs

AbstractIn this paper, we deal with problems of efficient resource management and scheduling in utility Grids. There are global job flows from external users along with resource owners’ local tasks upon resource non-dedication condition. Competition for resource reservation between independent users, local and global job flows substantially complicates scheduling and the requirement to provide the necessary quality of service. A meta-scheduling model, justified in this work, assumes a complex combination of job flow dispatching and application-level scheduling methods for jobs, as well as resource sharing and consumption policies established in virtual organizations (VOs) and based on economic principles. A solution to the problem of fair resource sharing among VO stakeholders with simulation studies is proposed

Scheduling Optimization in Grid with VO Stakeholders’ Preferences

The problem of intelligent Grid computing and job-flow scheduling with regard to preferences given by various groups of virtual organization (VO) stakeholders (such as users, resource owners and administrators) is studied. A specific flexible resources share algorithm is proposed for job-flow scheduling which enables to achive a balance between the VO stakeholders’ conflicting preferences and policies. This approach provides greater VO scheduling fairness, improves the overall quality of service and resource load efficiency. Two different metrics are introduced to find a scheduling solution balanced between VO stakeholders. Experimental results prove that the cyclic scheduling scheme allows establishing efficient cooperation between different VO stakeholders even if their goals and preferences are contradictory

Job Flow Distribution and Ranked Jobs Scheduling in Grid Virtual Organizations

In this work, we consider the problems of job flow distribution and ranked job framework forming within a model of cycle scheduling in Grid virtual organizations. The problem of job flow distribution is solved in terms of jobs and computing resource domains compatibility. A coefficient estimating such compatibility is introduced and studied experimentally. Two distribution strategies are suggested. Job framework forming is justified with such quality of service indicators as an average job execution time, a number of required scheduling cycles, and a number of job execution declines. Two methods for job selection and scheduling are proposed and compared: the first one is based on the knapsack problem solution, while the second one utilizes the mentioned compatibility coefficient. Along with these methods we present experimental results demonstrating the efficiency of proposed approaches and compare them with random job selection

Multiple Error Correction in Redundant Residue Number Systems: A Modified Modular Projection Method with Maximum Likelihood Decoding

Error detection and correction codes based on redundant residue number systems are powerful tools to control and correct arithmetic processing and data transmission errors. Decoding the magnitude and location of a multiple error is a complex computational problem: it requires verifying a huge number of different possible combinations of erroneous residual digit positions in the error localization stage. This paper proposes a modified correcting method based on calculating the approximate weighted characteristics of modular projections. The new procedure for correcting errors and restoring numbers in a weighted number system involves the Chinese Remainder Theorem with fractions. This approach calculates the rank of each modular projection efficiently. The ranks are used to calculate the Hamming distances. The new method speeds up the procedure for correcting multiple errors and restoring numbers in weighted form by an average of 18% compared to state-of-the-art analogs